12. Example Design Quiz

Annotation Instructions

Annotation instructions and examples are meant to set human annotators up for success. As such, it is important to be clear about the goal of the data annotation and all of the cases that annotators might see.

Which two kinds of examples should you include in your instructions for any data annotation? (Check two answers.)
SOLUTION:
  • At least one example for _each_ possible data annotation
  • Ambiguous or "tricky" annotation cases

You should also consider updating your examples in response to human-annotator feedback, as we will discuss in a moment.

Next Concept